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Abstract 

We show that for unrehable Jackson networks spectral gap is strictly positive iff the 
spectral gaps for the corresponding coordinate birth and death processes are positive. More- 
over, positivity of these spectral gaps is equivalent to the condition that for the stationary 
distribution of the network each of the one dimensional marginal distributions is strongly 
light-tailed, that is its discrete hazard function is separated from zero. Consequently, we 
obtain exponential ergodicity of unreliable networks iff for the corresponding stationary dis- 
tribution the strong light-tailness condition holds. Connecting marginal distributions with 
the corresponding service rate functions, we characterize exponential rate of convergence in 
terms of the service rate functions. 
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X, 

c3 1 Introduction 

We consider a class of Markov processes which describe Jackson type queueing networks with 
breakdowns and repairs. We show sufficient and necessary conditions for the existence of the 
spectral gap for some processes of this type, utilizing Cheeger's technical approach. As a con- 
sequence we obtain necessary and sufficient conditions for geometric ergodicity in L2 norm and 
in the total variation norm for such processes. These conditions are given in terms of hazard 
functions of the corresponding stationary distribution, and further in terms of the service rates in 
networks. More precisely, for unreliable Jackson networks spectral gap is strictly positive if and 
only if its stationary distribution is a product of strongly light-tailed (i.e. with the corresponding 
discrete hazard functions separated from 0) distributions. There is surely no spectral gap for the 



*address for both authors: Mathematical Institute, University of Wroclaw, pi. Grunwaldzki 2/4, 50-384 
Wroclaw, Poland. 

tWork supported by MNiSW Research Grant N N201 394137. 



1 



network when at least one of these distributions is not strongly light-tailed (usual light-tailness 
is not sufficient). It is worth mentioning that in the general theory of Markov processes such 
a property is not always present. There exist Markov processes with positive spectral gap, and 
having heavy-tailed stationary distributions. On the other hand there exist Markov processes 
without positive spectral gap and having light-tailed stationary distributions. 

The problem of stability and ergodicity of queueing networks is a classical one and has been con- 
sidered by many authors. Baccelli and Foss [2] considered quite general Jackson-type queueing 
networks, under stationarity and ergodicity assumptions on input sequences, and gave a path- 
wise construction of networks leading via subadditive ergodic theorem to some stability results 
for networks. Baccelli, Foss and Mairesse [3] provide interesting examples of networks with mul- 
tiple stationary solutions. Another approach to stability of Jackson-type networks, namely by 
stochastic dominance, was given by Chang, Thomas and Kiang 

For networks which have unique stationary and ergodic solution one of the main problems is 
to estimate the probability of overflow. This problem is intimately connected with the tran- 
sient behavior of networks before attaining stationarity and with the question about the speed of 
convergence to stationarity. Large deviations is a natural technique to deal with overflow proba- 
bilities. The problem of large deviations for classical Jackson networks was analyzed in detail by 
Ignatiouk- Robert [H] , using so-called twisted kernel which involve exponential change of measure, 
and showing explicitly the rate function for a two nodes network. Foley and McDonald |TT] show 
large deviations for a two nodes network with interaction and show some rough asymptotics for 
stationary distribution of such process. Adan, Foley and McDonald [1] developed a method for 
exact asymptotics for stationary distribution of Markov chain, which also can be applied to mod- 
ified Jackson networks. Lorek [20j gives exact asymptotics for stationary distribution for some 
modified networks. Another method to deal with overflow probabilities is simulation. Dupuis and 
Wang [9] developed simple and efficient state-dependent importance sampling schemes for simu- 
lating buffer overflows in stable Jackson networks. The mentioned results on overflow are directly 
related to one of the key performance properties in queueing systems, namely to the exponential 
decay rate of the steady-state tail probabilities of the queue lengths. It is of course present for 
classical queueing networks with constant service rates but in a more general setting it is not 
always present. For example, for multi-type networks it is known that if the stochastic primitives 
have finite moments, then the queue lengths also have finite moments, and the tail probability of 
the queue length decays faster than any polynomial. However, it is not always decaying exponen- 
tially fast even with exponential service times, as shown by Gamarnik and Meyn [L2l ■ The rate of 
exponential decay of the steady-state tail probabilities of the queue lengths was studied also by 
Kroese, Scheinhardt and Taylor [17] who interpreted Jackson tandem networks as a quasi birth 
and death (QBD) process and studied relations of the decay rates to the convergence norm of 
Neuts' R matrix. Dicker and Warren [8], using an approach via non-crossing probabilities, showed 
among other things that for the classical tandem Jackson networks its spectral gap is equal to 
the spectral gap of the M/M/1 queue with the same arrival and service rates as the network's 
bottleneck station, which allows to relate the corresponding relaxation times with the speed of 
convergence to stationarity. 

FayoUe et al. |10j considered the classical Jackson networks with constant service rates for each 
station. They constructed explicitly Lyapounov functions for these networks and showed the 
necessary and sufficient conditions for ergodicity without using the classical Jackson's product 
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form. Moreover they showed an exponential rate of convergence in Li norm to the invariant 
distribution of the corresponding Markov process. Hordijk and Spieksma [13] showed a similar 
result, obtaining geometric rate of convergence, but measured in the so called /—norm. An 
alternative measure for the convergence to stationarity of a stochastically increasing Markov chains 
can be expressed in terms of the deviation matrices as presented for M/M/s/N and M/M/s/oo 
queues by Koole and Spieksma [12], and further by Coolen-Schrijner and Van Doorn |n] for general 
ergodic Markov chains. 

The approach via spectral gap to the speed of convergence is a classical one in the context of 
particle systems, see e.g. Liggett [IS]. The problem of existence of the spectral gap for Jackson 
networks with non-constant service rates was considered by Iscoe and McDonald [15]. They 
showed that if a stationary distribution is a product of strongly light-tailed distributions then the 
spectral gap exists. 

We consider another modification of classical Jackson networks, allowing unreliable nodes. Unreli- 
able Jackson networks are networks, where in some subsets of the set of nodes the service stations 
can be broken and then repaired during the time evolution of the system. The breakdown and 
repair events can be of a rather general nature, but driven by a Markov process. In the time 
intervals when nodes are broken, there are several rules for rerouting. For full details of such 
networks see Sauer and Daduna [22], and Sauer [22]- In the latter also a rich historical overview 
of such networks can be found. Sauer in [22] showed that in the case of constant service rates 
/ij(-) = yUj and without rerouting (i.e. customers are allowed to join the queue at broken server, 
where they wait till repair), the corresponding discrete time uniformization chain is a Lyapounov 
Markov chain according to the terminology used by Fayolle et al. [TU]. Consequently, for such 
networks the rate of convergence in total variation distance is exponential and the stationary 
distribution is light tailed. 

We assume in our spectral gap result for unreliable networks that the routing matrix is reversible. 
For classical networks the reversibility assumption can be skipped. In the proof we use some ideas 
from the mentioned paper by Iscoe and McDonald [15], where the authors studied exit times 
for the classical Jackson networks, and they showed the existence of the spectral gap under the 
assumption of strong light-tailness - using some auxiliary birth and death processes. In our proof 
we relate the network process to the independent copies of the coordinate birth and death processes 
directly, so technically taken our proof is a different one. Stationary distribution of a Jackson 
network has a remarkable property: it is of a product form. Sauer and Daduna [23] showed an 
analogous property for the stationary distribution for unreliable Jackson networks. The product 
form of the stationary distribution for unreliable networks is a crucial property used in our work 
to extend the results of Iscoe and McDonald [I5], and of Sauer [22]- Using the existence of the 
spectral gap for unreliable queueing networks, we formulate an if and only if result connecting 
the exponential speed of convergence to stationarity with the strong light-tailness property of the 
stationary distribution. 

The task of obtaining positive lower bounds for the spectral gap of Jackson networks with state 
dependent service rates involves bounds on the spectral gaps for the corresponding coordinate 
birth and death processes (as in this paper) or some other related birth and death processes (as 
in Iscoe and McDonald [15]), and some additional factors reflecting dependence among the nodes 
of the network. The problem of bounding the rates of convergence of birth-death processes is a 
classical one, see e.g. Van Doorn [21] for a summary. A related comparison result for spectral 
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gaps for networks is given by Daduna and Szekli [7], Proposition 3.6, where a direct comparison 
to the spectral gaps for the corresponding coordinate birth and death processes is given without 
additional factors, but using an additional assumption on the routing. As an illustration we 
shall give some bounds on the spectral gap of a Jackson network in the last section, however the 
problem of finding exact bounds for (unreliable) networks is not solved in a satisfactory form and 
we leave it as a future research topic. 

The paper is organized as follows. In the next section we introduce unreliable networks by giving 
the respective generator. In section 3 we give the result relating the existence of the spectral gap 
of unreliable networks with the tail properties of its stationary distribution. We give a proof of 
this result and formulate direct consequences for exponential ergodicity of the network process. In 
section 4 we use equilibrium rates to reformulate our results from section 3. We show that strong 
light-tailness is stronger than usual light-tailness. Finally we give some bounds on the spectral 
gap for a Jackson network in section 4.2. 



2 Definition of the process 

The classical Jackson network consists of m numbered servers, denoted by M := {1, . . . ,m}. 
Station j G M is a single server queue with infinite waiting room under FCFS (First Come First 
Served) regime. All the customers in the network are indistinguishable. There is an external 
Poisson arrival stream with intensity A and arriving customers are sent to node j with probability 
^oj, YlJLi ^oj = r <1. Customers arriving at node j from the outside or from other nodes request 
a service which is at node j provided with intensity ^ij{n) {nj{0) := 0), where n is the number of 
customers at node j including the one being served. All the service times and arrival processes 
are assumed to be independent. 

A customer departing from node i immediately proceeds to node j with probability Vij > or 
departs from the network with probability ViQ. The routing is independent of the past of the system 
given the momentary node where the customer is. We assume that the matrix R := (rjj, i,j G M) 
is irreducible. 

Let Xj{t) be the number of customers present at node j, at time t > 0. Then 

X{t) = {X,{t),...,XUt)) 

is the joint queue length vector at time instant t > and X := (X(t),t > 0) is the joint queue 
length process with the state space E = Z™. 

The unique stationary distribution for X exists if and only if the unique solution of the traffic 
equation 

m 

Xi = Xroi + ^Xjrji, i = l,...,m (1) 
i=i 

satisfies 



oo 



A" 

Q := 1 + T-rn ' . . < OO, l<i<m. 
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The parameters of a Jackson network are: the arrival intensity A, the routing matrix it! (with 
its traffic vector A = (Ai, . . . , A^)), the vector of service rates // = (//i(-), . . . , //^(•)) and the 
number of servers m. Our standing assumption for all considered networks is that for all j, 
^. :— inf„/Xj(n) > 0. We denote the overall minimal service intensity by = mmj jj,^. 

Assume now that the servers at the nodes in the Jackson network are unreliable, i.e., the nodes 
may break down. The breakdown event may occur in different ways. Nodes may break down 
as an isolated event or in groups simultaneously, and the repair of the nodes may end for each 
node individually or in groups as well. It is not required that those nodes which stopped service 
simultaneously return to service at the same time instant. To describe the system's evolution we 
have to enlarge the state space for the network process as it will be described below. Denote by 
Mq := {0, 1, . . . , m} the set of nodes enlarged by adding the outside node. 

• Let D C M he the set of servers out of order, i.e. in down status and I <Z M \ D,I ^ ^ 
be the subset of nodes in up status. Then the servers in I break down with intensity 
a^^jim -.ieM). 

• Let D C M he the set of servers in down status and H <Z D,H ^ ^. The broken servers 
from H return from repair with intensity P^^uini : i G M). 

• The routing is changed according to so-called Repetitive Service - Random Destina- 
tion Blocking (RS-RD BLOCKING) rule: For D - set of servers under repair routing 
probabilities are restricted to nodes from Mq \ D as follows: 



Tij, i,jeMo\D, i^j, 



The external arrival rates are 

Arg = Xroj for nodes j E M\D, (2) 
and zero, otherwise. Let = {r^)i,j^Mo\D be the modified routing. Note that = R. 
We assume for the intensities of breakdowns and repairs $ ^ I C D and $ H C M \ D that 

«gu7(^.:^eM) := 

/35^^(n, : z e M) := 

where ■0 and are arbitrary positive functions defined for all subsets of the set of nodes. That 
means that breakdown and repair intensities depend on the sets of servers but are independent 
of the particular numbers of customers present in these servers. 

In order to describe unreliable Jackson networks we need to attach to the state space of the 
corresponding standard network process an additional component which includes information of 
availability of the system. We consider new state space 

n^{D,ni,n2,...,nm) eV{M) x =: E, 
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where V{M) denotes the powerset of M. The first coordinate in n we call the availability coor- 
dinate. 

The set D is the set of servers in down status. At node i E D there are rij customers waiting for 
server being repaired. Denote possible transitions by 



Ti,n := {D,ni, . . . ,ni - 1, . . . ,nj + 1,. . . ,njn), 

■ {D,ni, . . . ,nj + 1, . . . ,nm), 

: {D,ni,...,ni-l,...,nm), (3) 

: {D\H,ni,. . . ,nm), 

: {DUl,ni,...,nm). 



Definition 2.1. The Markov process X = {X{t),t > 0) defined by the infinitesimal generator 

m mm 

Qfin)= ^[/(To,n)-/(n)]Aro^. + ^^[f{T,,n)-f{h)]^^,{n,)rf^ + 

m 

5^[/(T,on)-/(n)]^,(n,)rfo 
zs called unreliable Jackson network. 

We denote the corresponding transition intensities (written in a matrix form) by [^(n, . 

Similarly to the classical case the invariant distribution for this Markov process can be written in 
a product form. 

Theorem 2.2 (Sauer and Daduna [23j). Let X be unreliable Jackson network following the RS- 
RD-BLOCKING. If the routing matrix R is reversible, i.e.: 

\jrji = Xirij, iJeMo, 
then the stationary distribution of process X is given by 

71 yii) = 71 yiy, iLi, . . . , Um) = 

where 



7f{n) = 7i{D,ni, ...,nm) = 77-77^ TT ^«(^»)' (^) 



1 A*^' ^ \n 

and C is the normalization constant used for the availability coordinate. 
Constants Ci, i = 1, . . . ,m are all finite if and only if the network is ergodic. 

Note that in this generality, the vector of the number of customers alone, without the availability 
coordinate, does not form a Markov process. It is a Markov process if the availability coordinate 
process is a trivial one, that is if nothing breaks down all the time. In this case this Markov process 
is identical with the classical Jackson network, and the reversibility assumption on routing is not 
needed then in order to obtain the classical product formula. 
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3 Spectral gap and convergence 



Consider a pure jump Markov process X = {Xt,t > 0) with denumerable state space E, with the 
matrix of transition intensities Q = [g(e, e')]e,e'GE; stationary distribution vr and the corresponding 
infinitesimal generator Q given by 

Qf{e) = J2[f{e')-f{eMe,e'), e G E. 

e'eE 

The usual scalar product on L2(E, vr) is denoted by 

{f,9)^ = Y.f{e)g{e)7r{e), 1 1/| |^ = (/, /)., 

eeE 

and by 1 the constant function equal to 1. We shall use the symbol 7r(/) to denote (/, 1)^. 
We denote the spectral gap for X by 

GapiQ) := inf {-(/, Q/). : H/lb = 1, 7r(/) = 0} . (7) 

The main result on the spectral gap for networks is a consequence of the following lemma, which 
relates the networks to the corresponding coordinate birth and death processes. The corresponding 
birth and death processes are independent processes which have their invariant distributions equal 
to TTj distributions in the product form formula for networks' stationary distribution. 

Lemma 3.1. Let X be unreliable Jackson network process following the RS-RD- BLOCKING, 
with the infinitesimal generator Q. Suppose that Q is bounded, and the minimal service intensity 
/i > 0. // the routing matrix R is reversible and regular (R^ > for some k > 1) then Gap{Q) > 
if and only if for each i = 1, . . . ,m, the birth and death process with constant birth rates Aj and 
state dependent death rates iii{n) have their corresponding spectral gaps positive. 

Theorem 3.2. Let X be unreliable Jackson network process following the RS-RD- BLOCKING, 
with the infinitesimal generator Q. Suppose that Q is bounded and the minimal service intensity 
H > 0. If the routing matrix R is reversible, and regular then Gap{Cl) > if and only if for each 
i = 1, . . . ,m, distribution (7rj)j>o is strongly light-tailed, i.e. inf^ h^^{k) > 0, for hT,.{k) = ^ .""'^t''-(j) • 

The proof of this theorem will be given in an extra section after gathering some useful facts on 
birth and death processes in the next paragraph. 

3.1 Spectral gap for related birth and death processes 

A proof of the next theorem can be found in Liggett [19|, Theorem 3.7. The formulation of it is 
simplified to the case of state independent birth rates. For a more complete description of criteria 
for positivity of spectral gap for jump processes see the book by Mu-Fa Chen [5], chapter 5. 
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Theorem 3.3 (Liggett [I9]). Assume that Z is a birth and death process on Z4., with state 
independent birth rates A > 0, and possibly state dependent death rates fj,{n) > 0, and for all 
i > 0, and for some b,c > 0, we have 

^^7r(j) < C7r(i)A and ^^7r(j) < bn^i). 

j>i j>i 

Then for the corresponding generator Q, 

Gam) > M±i^ > ' 



2c(l + 26)' 

In the case of constant birth rates, from the CoroUary 3.8 of Liggett [19|, we have that a necessary 
and sufficient condition for Gap(Q) to be positive is that the stationary distribution is such that 

mf^.^>0. 

* Li>i7r(j) 

It is natural to recall at this point that the ratio above defines so called discrete hazard function. 
For arbitrary distribution {p{i),i > 0) on Z+, such that for all i, p{i) > we define its hazard 
function by 

This function has some analogous properties to the continuous hazard rate function and is con- 
venient to describe tail properties of the corresponding distribution function. We will get back to 
this point in a later section. We say that a distribution {p{i),i > 0) on Z+ is strongly light-tailed 
if 

mi hp{i) > 0. 

We shall see later that such a distribution is light-tailed in a usual sense. 
We shall use the following reformulation of Liggett 's result 

Proposition 3.4. Assume that Z is a birth and death process on Z+, with state independent birth 
rates A > 0, and possibly state dependent death rates ii{n) > 0, and for all i > 0, and for some 
e > 0, uniformly in i, we have 

K{i) > e- 

Then for the corresponding generator Q, 

Gap{Q) > 



2(l-e)(2-e) 



A necessary and sufficient condition for Gap(Q) to be positive is that the stationary distribution 
TT is strongly light-tailed. 

In the proof of Theorem 13.21 we shall compare networks processes with their coordinate birth and 
death processes utilizing the following theorem. 
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Theorem 3.5 (Liggett [19], Th. 2.6). Suppose that a pure jump Markov process X, with gen- 
erator Q and stationary distribution tt evolves on the product state space E = Ei x E2 x • • - K^, 
m > 1, having coordinates which are independent Markov processes such that i—th coordinate has 
generator Qj, denumerable state space Ej and invariant probability measure TCi. Then tt is the 
product measure of vTj 's and 

Gap{Q) = infGap(Qi). 



3.2 Proof of the theorem on spectral gaps 

We shall first proof Lemma 13.11 

Denote by Q the generator associated with (m + l)-dimensional vector (Y^, X^), where X^ is the 
vector of m independent birth and death processes with generators Qj, i = 1, . . . ,m, given by 

QJ{n) = [f{n + 1) - f{n)]X, + [f{n) - f{n - l)]/i.H, neN. (8) 

We write [^(n, n')]^ ^/g^ for the corresponding transition intensities. 

The stationary distribution of the process with generator Qj is vTj, which is given in the product 
formula ([6]) for networks. Let Yf be the process on state space V{M) with infinitesimal generator 
denoted by Qo and the stationary distribution: 



From Theorem 13.51 we have that GapiCl) = min Gap(Qj). The state space V{M) is finite, thus 

0<i<m 

GaplQo) > 0. In order to compare spectral gaps of the process with the generator Q and the 
network process with the generator Q we will use Cheeger's constants. 

Define the following Cheeger's constants: 

EngA7r(fl)9(fi, . , . 

Ki{A) := ^fA\^fAc\ ' ^1 •= - '^U^)' 

Tr{A)Tc{A'') Ace, 7r(A)e{o,i) 

>^2{A) := , K2 := _ mf K2{A), 

n[A)'K[A'') Ace, 7r(A)e(o,i) 

where tt is taken from ([5]). 

We shall show that there exist f 1 > 0, f 2 > such that uniformly for all A C E 

V2 J2 ^(n)g(n, A'^) > J2 ^(n)g(fi, ^1 > ^1 E ^(n)^(n, A^). (9) 

nGA ncA heA 



Suppose that we show the existence of such vi,V2 as in ([9]), and suppose that Gap(Q) > 0. From 
Theorem 2.1 in Lawler and Sokal [18J, we have that < Gap{Cl) < k,2, and uniformly in A, 
i^2{A) < (fi)^^Ki(A), hence ki > 0, which in turn using Theorem 2.3 in Lawler and Sokal [18] 
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(which assures that k^/(8|Q|) < Gap{Q)) imphes that Gap^Q) > 0. Here |Q| is the supremum 
norm of the bounded generator Q. 

Similarly, it is possible to argue that Gap{Q) > implies that Gap{Q,) > 0. 

In order to complete the proof we turn now to show validity of iQ which is equivalent to 

mf <^ ^^^^ . >>0 and sup <^ \ < oo. (10) 

7r(A)e(0,l) 7r(A)e(0,l) 

We have 

Eng^7r(fi)g(n,A--) _ 
Efie^^(n)g(ii,^^) 



Let 



g™'^= inf {g(n,A'^)}, g'"'^^ = sup {q{n,A^)}. 

A,hGA:q(h,A<=)>0 yl,neA:(j(n,yl<=)>0 



From our assumptions the generators are bounded and /i > 0, therefore g™" > 0, and q"^"'^ < oo. 
For 

r^"= inf {g(n,A^)}, r'^^= sup {g(fi,A^)}, 

we also have g"^*" > and q™'"'^ < oo. 
For a fixed A it is natural to define 

dA = {iieA: g(ii, A') > 0}, = {fi G A : g(n, A") > 0}. 

Because the ratio under consideration can be written as 

Evr(n)g(n,A'=) 

nedA 



E 7^{n)q{ii,A' 

nedA 



we obtain 



E^(n) E^(^)^^(^^'^') E^(^) 

~max - - ~min 
Q h€dA ^ hedA ^ q h€dA 



E-(^)" E-(^)^(f^'^^)"^"^'^^ E-(^) 

hedA h£dA iiGdA 
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Therefore, in order to show (fTOl) it is enough to check that for any A C E, such that 7r(A) > 

oo>^i^^ >0. (11) 

n€dA 

Let US examine the difference between 7r(n) and 7r(n'), where n' and n are different on each 
coordinate by not more than 1, and both n and n' have the same set of broken nodes /. 

Recall from 1^ that for n = {D, ni, . . . , rim) ^ V{M) x Z™ we have: 



7r(n) = n{D, ni, . . . , n^) = -j^—TjyT JJ T^i{ni), where ni{ni) 



For nj > 1, 



1 X^^i + l \ 

7r,(ni + 1) = 777T;r+i — TT = ^ii^i)- 



and 

thus we have bounds using ^. := inf„/ij(n) > 0, and Jij := sup„ /ij(r2) < oo, of the form 



For 



^) 7ri(ni) < 7ri(ni - 1) < Tiiini) (^^ 



we have 



iTi{ni) < TTi{ni ± 1) < diT^iirii). 



Thus, if we take n and n' which may differ by at most ±1 at each coordinate, we obtain 

-7r(fi') < 7r(fi) < d7r(fi'). (13) 
a 

It is possible that there are states which are in dA and not in dA, and also such that they are 
in dA but not in dA. For z G dA \ dA., there exists some y^. G A'^ such that process with kernel 
q cannot move from z to y^. in one step, but process with kernel q can. State y^. must be of the 
form y^ = Tj^z, and it cannot be of the form y^ = T^z or y^. = T^z, since the change of the 
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set of broken nodes in the state z is always possible for both processes. Moreover, it is neither 
of the form y^. = Tjoz nor of the form y^. = Tqjz, because both processes can move in these 
directions in one step. There exists however a two step path Tjo,Toj such that z' = T^oz G A and 
= Tqjz' G A^, and then either z' G OA \ dA or z' G OA fl OA. Because each z G 9^4 \ must 
be a corner point, it is possible to select different points z' G \ dA) U (9A fl SA) for different 
points z. 

Thus using (IT^ we can give a rough bound 

5^7r(fi) 7r(fi)+ J2 ^(^^) 

fieoi iieainaA hedA\dA 



> 



AeOA nedAndA n.£dA\dA 

neainaA \neaAnaA neai\aA 

neainaA nGaA\aA 1 



> — 

ViieainaA neaA\aA 

Fix X G \ 9y4. Then there exists some y^ G A'^ such that original process with the kernel q 
cannot move there in one step, but the process with the kernel q can. State y^ must be of the 
form y^ = ToioX or y^ = Tj^^o^, it cannot be of the form y^ = T^y or y^ = Tny, as previously. 
Because for a selected location in the state space, for the network process, at least one transition 
of the form Tq^ must be possible, and at least one transition of the form Tiq must be possible (for 
some k,l), and for the coordinates (nodes) where a transition from outside is not possible, there 
must be a migration transition into it (T^.io' say), there exists path of length at most m such that 
process with kernel q gets along this path to y^. The path consists only of transitions of the form 
Toi,Tjo,Tij, and at each intermediate step the coordinatewise distance to y^ is not larger than 1 
on each coordinate. Further, there exists a state x' on this path such that x' G dA (1 dA, namely 
at the location where the transition Tq^ is possible. Moreover the function x — )• x' can be defined 
as 1-1. Thus, using (IT^ . we again give a rough bound 

J]7r(n) Y ^(*^)+ E ^(*^) 

nedA neaAnaA nedA\dA 



neaA h(^dAndA hedA\dA 
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< 



hedAndA \nedAndA xedA\dA 

hedAndA h&dA\dA 




hedAndA h£dA\dA 



1 + d < oo. 



J2 ^(^)+ J2 ^(^) 

This finishes the proof of Lemma 13.11 

The statement of Theorem 13.21 is a direct consequence of the above lemma and Proposition 13.41 
3.3 Speed of convergence 

Before formulating a result about speed of convergence for networks we recall from Mu-Fa Chen 
[5] some useful theorems. For a general picture showing ergodic results for Markov processes 
see this reference. For a Markov process governed by semigroup (Pt), with generator Q, the 
classical variational formula can be written as G'ap(Q) = inf{ — (/, Q/)^ : 7r(/) = 0, II/II2 = 1}, 
where {f,g)-K = J f{x)g{x)'7i{dx), n is invariant for (Pt), and 7r(/) = J f{x)n{dx), VarT,{f) = 
7r(/2) - (7r(/))2. Let / G L^{E,7i). Then C = Gap{Q)-^ is optimal in: 

Poincare inequality : Var^^^f) < C ■ {f, —Qf)n- 

It is known that the above inequality is related to the following convergence (see e.g. Mu-Fa Chen 
[S], Theorem 1.8.). 

Theorem 3.6. Poincare inequality holds if and only if Markov process converges according to 
L2(E, tt)— exponential convergence: 

for all f e L2(E,7r) 

II Ptf-T^if) \\l= Var{PJ) < Var{f)expi-2GapiCl)t), t > 0, 

Dual convergences for distributions one defines by (here the subscript tv denotes convergence in 
the total variation norm): 

ergodicity: for each e G E 

II 6ePt - VT \ \tv^ 0, t 00, 

exponential ergodicity: for each e G E there exists C(e) > such that for some a > 

\\ 5ePt - \\tv< C{e) exp{-at), t > 0. 

The above statements are related in the following way (see e.g. Mu-Fa Chen [5], Theorem 1.9.) 
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Theorem 3.7. Suppose that E is countable and Pt reversible. Then for all f G L^(E, vr) 

\\Ptf- <f) \\l= Var{PJ) < Var{f)exp{-2Gap{Q)t), t > 0, 
if and only if for each e G E there exists C{e) > such that 

II S^Pt - vr \\t.< C(e)exp(-Gap(Q)t), t > 0. 

For non-reversible cases the exponent a in the exponential ergodicity definition can be different 
from Gap(Q). 

As a consequence of Mu-Fa Chen's [5], Theorem 1.9. and Theorem 8.8 we obtain 

Proposition 3.8. Let X be unreliable Jackson network following the RS-RD-BLOCKING, with 
generator Q, given by and the corresponding transition semigroup {Pt)- Suppose the routing 
matrix R is reversible, and R^ > for some k > 1. 

If Tii is strongly light-tailed, for each i = 1, . . . ,m, then equivalently 
(i) for all f G L2(E,7r) 

||P*/-vr(/)|b<e-^''^(Q)*||/-7r(/)||2, t > 0, 

(a) for each e G E there exists C{e) > such that 

||<5ePt-vr||t, <C(e)e-^'^P(^)*, t > 0. 

Remark. For the classical Jackson networks, i.e. networks without breakdowns and repairs 
('V^(0) = 0(0) = 1,'0(Z)) = 0(-D) = for Z) 7^ 0) the reversibility assumption on the routing 
matrix R can be relaxed in order to obtain the implication [i) =^ [ii). 

4 Discussion of the assumptions 

We formulated the results on the positivity of the spectral gap and on the convergence to sta- 
tionarity in terms of the discrete hazard function of the stationary distribution. We assumed that 
the hazard function is separated from zero and called this property exponential light-tailness. For 
queueing networks it would be however more reasonable to formulate the assumptions in terms 
of the parameters of the network. Therefore we shall now introduce so called equilibrium rates 
for discrete distributions and use them to reformulate our assumptions and to connect them with 
the service rates in the system. 
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4.1 Discrete hazard rates and equilibrium rates 



For a non-negative random variable X G with probability function p{k) = P{X = k), such 
that for any k G Z+, P{X = k) > 0, recall that one defines the equilibrium rate function by 

f if k>l, 

'^^'^-[ T if .=o; 

and the hazard function by 

Kik) - jf^y k > 0, (14) 

where F{k) = P{X > k). Distribution (or random variable) is strongly light-tailed if there exists 
e > such that inffc hp{k) > e. 

Since the equilibrium rate function {ep{k),k > 1) uniquely determines the probability function 
{p{k),k > 1), the hazard function {hp{k),k > 0) uniquely determines the corresponding distribu- 
tion. It is therefore possible to express hght-tailness in terms of equilibrium rates. The following 
formulas connect both functions 

and 



1 

■'j=k+l ep{k+l)-ep{j) 



h,{k)^ ^ ^ ^ , ^ k>Q. (16) 



It is worth mentioning that each discrete distribution with the support Z+ can appear as the 
stationary distribution for a birth and death process with constant birth rates. Moreover the 
existence of the spectral gap can be characterized directly using the birth and death rates. 

Lemma 4.1. Consider {p{k)}k>Q an arbitrary probability function on'Z+j such that p{k) > 0,k> 
0, with the corresponding equilibrium rate ep{k), k >0. Then for each birth and death process X 
with fixed X{k) = A > 0, A; > 0, and 

fj.{k) = A • ep{k), k >0, 

(i) the stationary distribution o/X is equal to p{k), k > 0, 

(ii) the spectral gap for X exists if and only if 

inf ^- > 

Proof, (i). For the stationary distribution n of the birth death process we have 

A ■ ■ ■ A A* 

'^p(l) p(2) ■ ■ ■ p(i) 
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Thus we have (i). 

The conclusion in (ii) follows directly from (|T6|) . and Proposition 13.41 

□ 

Neither hp{k) nor ep{k) have to be convergent as A; — > cxd. However from (|T5|) . f lT6|) we obtain a 
connection between these limits if they exist and are finite. 

Lemma 4.2. Consider {p{k)}k>o arbitrary probability function on such that p{k) > 0,k > 
0, with the corresponding equilibrium rate ep{k), k > 0. Then 

hp = limfc_s.oo hp{k) exists and hp G (0, 1) if and only if Cp = limfc^oo ep(/c) exists and Cp G (1, oo). 
In this case ^ 

hp = l . 

From the above lemma and in addition observing that non-decreasing fi{k) as a function of k 
corresponds to the hazard function which is a non- decreasing function we have two situations 
when the spectral gap is positive for birth and death processes with constant birth rates. 

Corollary 4.3. Suppose for a birth and death process X with fixed X{k) = A > 0, k > 0, 
and fJ^{k), k > 0, that limfc_j.oo/^(fc)/A exists and is strictly greater than 1. Then the stationary 
distribution vr for X is strongly light-tailed and the spectral gap for X exists. 

Moreover, if fi{k) is non- decreasing as a function of k then 

Gap(Q) > -, 

- 2(1 -e)(2-e)' 

/or6 = 7r(0) = (l + Er=in^)"'>0- 

Corollary 4.4. Let X be unreliable Jackson network process following the RS-RD-BLOCKING, 
with the infinitesimal generator Q. Suppose that Q is bounded and the minimal service intensity 
/i > 0. // the routing matrix R is reversible, and regular then Gap^Q) > if and only if for each 
i = 1, . . . ,m, 

inf — > 0. 

k . v^oo X- 

In particular, if for each i = 1, . . . ,m, limj^^oo f^i{k) / exists and is strictly greater than 1, then 
Gap{Q) > 0. 

We shall now indicate relations between discrete hazard functions and usual (continuous) hazard 
functions, and show that strong light-tailness implies the usual light-tailness. The total hazard 
function Hp is defined for all x > by 

Hp{x) = -logF(x). 
Note that for natural arguments k >0 

k 

Hp{k) = -logl[{l-hp{j)), (17) 

j=0 
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and for arbitrary x > 

H,{x) = -logn(l - h,{j)) = f^log ) , (18) 

where \_x\ denotes the integer part of x. 

Note that each sequence h{i) G (0, 1), z = 0, 1, . . . defines by the above formula a discrete dis- 
tribution function F with the support {0, 1,2,.. .}. An arbitrary distribution F with its support 
contained in [0, oo) is hght-tailed if e^^dF{x) < oo. It is known (see e.g. Rolski et al. |2T] . 
Th. 2.3.1) that 

liminf log(-F(x)) > 

implies that F is light-tailed. 

Lemma 4.5. Consider a random variable X G Z+, with probability function p{k) = P{X = k), 
such that for any k G P{X = k) > 0, and p is strongly light-tailed. Then it is light-tailed in 
the usual sense. 



Proof. Note that 



for all X > 0, therefore 



H.jx) ^ H,i[x\) 



X 



[xj + 1 ' 



inf > ^ hminf > 0. (19) 

n n + 1 x^oo X 

From the exponential light-tailness we have for all j, log( ^_^^ ^^.^ ) > log{^^), and hence from flTHl) 

HJn) , / 1 , 

> log ( 1 > 0, 

n-\- 1 

which from f|T9|) implies that Fp is light-tailed. 



□ 



In order to see that exponential light-tailness is strictly a stronger notion than light-tailness for 
discrete distributions we give a simple example. This example shows at the same time that there 
exists a birth and death process having its rate of convergence to stationarity not exponentially 
fast, but having its stationary distribution light-tailed. 

Example 4.6. Let us take as p the distribution which corresponds to the hazard function hp 
given by hp{l) = 1/2, 



hp{k) 



1/k if = 2n + 1, n>l, 
1/2 if k = 2n, n>0. 

This distribution is not strongly light-tailed since infk hp{k) = 0. However, for each natural n, 

lim„_j,oo ^^2n+2^^ ~ li^n-i'oo ^2n+i ~ lo§(2)/2 > 0, and from ( |T9l) we obtain that p is light-tailed. 
From Lemma 14.21 we can define the corresponding birth and death process with its stationary 
distribution equal to p, and having constant birth rates. The rate of convergence to stationarity 
for this process is not exponentially fast, however its stationary distribution is light-tailed. 
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4.2 Bounds on the spectral gap 

From the proof of Lemma [3.11 we can get bounds on Gap(Q). We have Ki > V1K2, where Ki and 
K2 are the Cheeger's constants of Q and Q, respectively. Using rough estimates from the proof of 
Lemma [3. H we have 

~min ^ 



gmax dj^l 

From Theorems 2.1 and 2.3 of Lawler and Sokal [18] and from Theorem 13.51 we have 

.2 , ,2 



GapiQ) > i [min Gap(Q,) j " . (20) 

8 1 I ^ 

By Proposition 13.41 

min Gap{Q) > min — '-^ -, (21) 

where e,- is a lower bound on the hazard function ■ 



For a Jackson network with constant service rates fii{n) = /ij we have constant hazard function 

(1 - ^ 



KXk) = 1 - and 

min 



Gaj9(Q) > -^- 
~ 32|Q| 



, 1 -I- ^ , 



Calculating the bound using this method is quite straightforward, provided the solution of the 
traffic equation is given. In Iscoe and McDonald [K], their method requires some computations 
for two intermediate birth and death processes. For large number of servers, it is far from being 
st raight forward . 

Example 4.7. We will give a bound for the spectral gap of the standard two-node Jackson 
network with parameters: 



A = 12, /ii(n) = 20-2-'',/X2(n) = I6-4-", R 



1/3 2/3 
1/2 1/2 
3/4 1/4 



Solving traffic equation yields Ai = 48/7, A2 = 80/7. One can easily check, that system is stable. 
We have /i^ = 19, /ii = 20, /i^ = 15, J12 = 16, and g™" = 4, g"'*^ = 20. Further, d = rfida = 49/12. 

Using IQI = A + /xi + /i2 = 48 and z/i = ^(1/(1 + 49/12)) = 60/61 we have from ([2D]) 

75 / - \ 2 

Gap{Q)>^^iminGap{Cl,)) . 

Since /ii(n) and ^2{n) are non- decreasing, we can have bounds on Gap{Cli),i = 1,2 from Corollary 
01 Calculating = (1 + J2n=i n"-f/.»fa) )~^ i = 1, 2 we obtain ei = 0.6502, €2 = 0.2818. This 
provides bounds: Gap{Qi) > 4.7220 and Gap(Q2) > 0.7839. 
Finally 

75 9 

Gap(Q) > (0.7830)^ = 0.001544667932. 

/^v^; - 29768 ^ ' 
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